• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    Method of managing a robotic system for minimally invasive surgery comprising: planning the position and orientation of an effector from the displacement of a haptic device, reference and modeled coordinates of the effector and position estimation of the fulcrum; obtain joint positions and speeds so that the robotic unit locates the following position and orientation of the effector; move the effector; measure forces and pairs exerted by said effector and by a minimally invasive instrument when performing said movement; determine the contribution of said measurement due to the interaction with the fulcrum point and with the internal tissue; estimate the distance outside the fulcrum point with respect to the modeled effector; estimate the rigidity of the tissue in contact with the instrument and calculate a simulated reaction force; send it to the haptic device and turn it to the surgeon's hand. (Machine-translation by Google Translate, not legally binding)
    公开号:ES2607227A1
    申请号:ES201630855
    申请日:2016-06-23
    公开日:2017-03-29
    发明作者:Enrique BAUZANO NÚÑEZ；Carmen LÓPEZ CASADO；Víctor Fernando Muñoz Martínez；Carlos Jesús PÉREZ DEL PULGAR MANCEBO
    申请人:Universidad de Malaga；
    IPC主号:
    专利说明:

    HANDLING METHOD OF A ROBOTIC SYSTEM FOR MINIMALLY INVASIVE SURGERY Field of the Invention
    The present invention belongs to the sectors of surgery and robotics, specifically that of the support systems for surgical practice, and more precisely to robotic systems specially designed as surgical instruments. Background of the invention
    Minimally invasive surgery consists in performing an intervention through a minimum number of small incisions to the patient, around 1-2 cm in length. Specifically, laparoscopic surgery is a minimally invasive type of surgery in which long cane-shaped tools are used to perform the surgical intervention. The number of tools depends on the intervention but at least one of them should be able to transmit to the surgeon an image of the surgical field, and usually consists of an optician with a camera attached to the end external to the patient. This surgical technique can be used in many interventions such as abdominal (cholecystectomy, nephrectomy, prostatectomy ...), intracranial (tumor resection ...) or traumatology (arthroscopy, orthopedics ...). In the case of abdominal laparoscopic surgery, it is necessary to create an abdominal vault by inserting an inert gas (usually carbon dioxide) to allow the mobility of laparoscopic tools, so that the gas is occluded inside the abdominal cavity by the use of special valves called trocars that are placed in the abdominal incisions and allow the passage of surgical tools.
    Laparoscopic surgery has a series of advantages for the patient such as the presence of smaller scars after the intervention and a much shorter postoperative recovery time than in open surgery. However, laparoscopic surgery limits the surgeon's abilities with respect to those of an open intervention. Some examples are the loss of three-dimensional vision when viewing an image on a screen, the inversion of movements of the laparoscopic tools due to the restriction of movement inherent to the insertion point that is located in the incision or fulcrum point, as well as the loss of tactile sensation when the surgeon's fingers are not in direct contact with the patient.
    One solution that the state of the art proposes to these problems is to use a robotic device as an intermediate tool for the surgeon. These robotic devices can have one or more manipulator arms according to the number of tools they are capable of manipulating, and can be classified into two main groups: robotic assistants and teleoperated robots. Robotic assistants are able to perform specific tasks in the surgical field autonomously or through simple commands commanded by the surgeon through a control interface. On the contrary, in teleoperated robots the movements of the surgical robot or slave system correspond directly to the movements made by the surgeon (usually the hands) or master system, to improve the skills and precision of the surgeon with the laparoscopic tools, such so that the robot almost or completely lacks autonomous movement capabilities.
    Robotic assistants have the advantage that they do not need direct human intervention except to command the orders desired by the surgeon, so that they behave like a human assistant to the surgeon for the purpose of the intervention. The biggest drawback is that a robotic assistant is usually programmed to perform very specific tasks, so it cannot be used generically during an intervention as a human assistant. For example, the Spanish patent ES2298051B2 presents a robotic assistant capable of handling the laparoscopic camera using voice commands given by the surgeon, with other features such as flexibility in positioning around the patient thanks to a wheel-based structure system and to the complete absence of cables since it can work with batteries.
    As for the group of teleoperated robots, as previously mentioned, its purpose is to improve the surgeon's skills. For this, the main surgeon in the patient's surroundings is replaced by the surgical robot (slave system), so that the new location of the surgeon will consist of a platform called console (master system) from which you will have all the necessary tools to Control the surgical robot and carry out the intervention.
    Various surgeon skills can be improved from the console by using specific devices. From the point of view of vision, in the US patent application US20070276423A1 the use of a three-dimensional vision system is proposed through the use of stereoscopic optics, which transmits each of the images to the corresponding eye by means of mirrors.
    The movement of the manipulator arm (s) that make up the surgical robot is controlled by the surgeon through special mechanical devices with positioning sensors called haptic devices or haptics, which are located in the console and are usually handled through from the surgeon's hands. As specified in US patent US7025064B2, these haptic devices allow not only the handling of


    surgical robot, but also can improve the precision of the movements of laparoscopic tools by applying scale factors that reduce the displacement of laparoscopic tools with respect to the displacement of the surgeon's hands. The use of haptic devices is not the only means by which the surgeon can direct the movement of laparoscopic tools, for example in the international patent application WO2011125007A1 the use of an eye tracking system capable of guiding the laparoscopic chamber is proposed according to the direction to which the surgeon's gaze is directed.
    Haptic devices may also include servo-actuating elements to apply reaction forces on the surgeon, so that the surgeon can perceive contact sensation of the laparoscopic tools that he is handling with the patient's internal tissue. For this, the surgical robot must have at least one force and / or torque measuring device for each manipulator arm with which the contact pressures between the laparoscopic tools and the patient's internal tissue or additional surgical instruments can be translated. For example, in US patent application US2013012930A1 it is proposed to send these measurements in the form of an electrical signal to the servo actuators coupled to the haptic devices by means of a communication control system that must meet a series of specific requirements to ensure the stability of the interaction between the slave system (surgical robot) and the master system (console), what is known as feedback from haptic forces. This feedback of the interaction forces between the surgical robot and the patient's internal tissue does not have to be solely pressure, but there are other proposals, such as that of the US patent application US2014005682A1, which allow the feedback of tactile sensations, such as the roughness of a surface, through the use of ultrasonic surgical tools.
    One of the main problems of feedback of haptic forces in a surgical robot not considered in US2013012930A1 or in US2014005682A1 is that there are normally two contact areas between the laparoscopic tool operated by the surgical robot and the patient: the abdominal area on the that the incision is made (hereinafter fulcrum point) and the area of internal tissue that the surgeon wishes to manipulate. Therefore, for a correct tactile perception of the surgical field, the contribution of both interactions should be separated from the measurement of the force and / or torque measurement device.
    The contact force between the laparoscopic tool and the fulcrum point depends largely on the type of mechanism that performs the orientation movements of the laparoscopic tool handled by the surgical robot. For example, in the aforementioned documents US7025064B2 and ES2298051B2 a passive actuation mechanism is used that limits the force exerted by the surgical tool on the abdominal skin but increases the uncertainty in the positioning due to the strike with the trocar. In the aforementioned US20070276423A1 a mechanism called a center of remote rotation is used, which mechanically transfers the center of rotation of the surgical tool to the fulcrum point, so that the problem of this method is reduced to initially calibrating the position of the center of remote rotation, so that if it changes during the intervention it will have to be recalibrated. In US patent application US2015359597A1 it is proposed to use a second manipulator arm to know the location of the fulcrum point, so that this second manipulator holds the surgical tool at its insertion point of the laparoscopic tool through its final effector in the patient
    In summary, the state of the art has the following limitations: On the one hand, there are proposals that allow the surgeon to perceive the interaction of forces between the surgical tools and the patient, but they do not take into account the superposition of the forces exerted by the laparoscopic tool on the point of insertion and the manipulation of the patient's internal tissue. On the other hand, the proposals to control the movements of laparoscopic tools operated by a surgical robot depend on mechanisms that,
    Either they produce a certain strike / inaccuracy in the positioning of the surgical tools, or they require off-line recalibration, both at the beginning of the intervention and before the displacement of the fulcrum due to factors such as a possible displacement of the patient on the couch. . Finally, the proposals of surgical robots presented only allow one type of correspondence between the displacement of the haptic devices and the laparoscopic tools, so that the position of the final effector of the haptic device can only correspond to the position of the distal end of the laparoscopic tool handled by the surgical robot. Description of the invention
    In a first aspect of the invention, a control method of a remotely operated surgical robot that overcomes the drawbacks identified in conventional surgical robot control methods is provided.
    In particular, at least one robotic arm is controlled, so that a surgical tool coupled to the robotic arm moves or orientates correctly within the cavity defined by the incision made in the patient. In addition, the forces applied by the surgical tool are fed back to a control unit or console, to provide sensory information to the surgeon who is remotely manipulating the surgical tool, thus helping the surgeon move the tool as if it were performing a direct manipulation on the patient.
    In accordance with one aspect of the invention, there is provided a method of handling a robotic system for minimally invasive surgery, where the robotic system comprises: a control console comprising the


    less an actuator device and a haptic device which in turn comprises one or more positioning sensors and servo actuators; and at least one robotic unit comprising: a manipulator arm, an effector disposed at the distal end of said manipulator arm, said effector being equipped with at least one force and torque sensor, at least one actuator, and a minimally invasive instrument coupled to said effector, where the distal end of said minimally invasive instrument is configured to enter a cavity of a patient's body through a fulcrum point. The method comprises the steps of: planning a position and orientation of the effector based on a relative displacement of the haptic device, reference coordinates of the effector, coordinates of the effector according to a model of the robotic unit and an estimate of the fulcrum position; from the coordinates of the effector according to the model of the robotic unit and of the planned position and orientation of the effector, obtain some positions and articular speeds necessary so that each degree of freedom of the robotic unit moved by the actuator makes that, together , the following planned position and orientation of the effector is achieved; moving the effector by means of the at least one actuator in accordance with said joint positions and speeds; measuring at least one force and torque sensor coupled to the effector forces and torques exerted by the effector and by said minimally invasive instrument coupled thereto, when performing said movement; determine in what percentage of contribution the measurement of forces and pairs is due to the interaction with the fulcrum point or to the interaction with the patient's internal tissue; re-estimate the position of the fulcrum, where that estimate is made from the contribution due to the interaction with the fulcrum point and the coordinates of the effector according to the robotic unit model; estimate the stiffness of the tissue in contact with the distal end of the minimally invasive instrument and calculate a simulated reaction force; Send this simulated reaction force to at least one servo actuator of the haptic device to be provided to the surgeon's hand.
    In a possible embodiment, the coordinates of the effector according to the model of the robotic unit are obtained from an articular position of the model.
    In a possible embodiment, the relative displacement of the haptic device is obtained from the difference between an absolute position and torsion of the haptic device and a reference position and torsion. In a more particular embodiment, to this difference between an absolute position and torsion of the haptic device and a position and torsion of reference are applied scaling factors of position KP and torsion K
    established by the surgeon to increase the precision of the movement, and a reduction factor Ks related to the simulated reaction force.
    In a possible embodiment, to estimate the fulcrum, the outer distance is estimated
    along the axis of the minimally invasive instrument to which the fulcrum point is located with respect to the position of the effector according to that model of the robotic unit.
    In one possible embodiment, the estimation of the stiffness of the tissue in contact with the distal end of the minimally invasive instrument and calculation of a simulated reaction force is made from the contribution due to the interaction with the patient's internal tissue, of the coordinates of the effector according to the model of the robotic unit and the displacement of the haptic device made by the surgeon's hand.
    In a possible embodiment, the calculation of a simulated reaction force is made from the following expression: {H}{H} {H} 0
    KFK P
    PFH
    T HH
    where {H} FH represents the simulated force, KF is a scaling factor, with KF <1, KT is the dynamic stiffness, {H} PH is the current haptic position and {H} PH0 is the last haptic position.
    In a possible embodiment, the method further comprises: from the position and orientation of the effector according to the model of the robotic unit, the planned position and orientation and the position and orientation of other robotic units, if any, verify that the position and orientation planned for the final effector of the robotic unit meet certain safety criteria, and restrict said position and orientation in case such criteria are not met.
    In a possible embodiment, the method further comprises: through an interface of the control console, selecting a minimally invasive instrument movement mode: a first mode in which the displacement of the haptic device is related to the displacement of the distal end of the minimally invasive instrument; or a second modality in which the displacement of the haptic device is related to the displacement of the effector of the manipulator arm, so that the pivot movements of a minimally invasive manual instrument through the haptic device are simulated.
    In a possible embodiment, any of the above steps is carried out if said actuator device is pressed or operated.
    In a preferred embodiment, the actuator is a pedal.
    In accordance with another aspect of the invention, a computer program product is provided comprising instructions / computer program code for performing the method described above.
    In accordance with a final aspect of the invention, a computer-readable storage medium / medium is provided that stores program code / instructions for performing the method described above.


    The method is implemented in a system that allows remote manipulation of laparoscopic tools manipulated by a surgical robot (slave system) through an interface or console (master system) managed by a human user. The master system includes at least one screen that allows viewing in real time the surgical field in two or three dimensions, an actuator device through which to activate or deactivate the handling of laparoscopic tools and two servo-actuated and sensed mechanical devices (haptics), which on the one hand they record the movements made by the user's hands to move and orient individual reference points determined by each haptic, and on the other hand they allow to transmit a force on the user's hands through the servo actuators in the user's hands. The slave system can be integrated by one or several modules, each of which comprises independent servo-actuated and sensed devices (robots / manipulator arms), at whose distal ends a laparoscopic tool is coupled and whose function is based on reproducing the movements registered by its associated haptic device so that said laparoscopic tool moves synchronously with the user's hand. The haptic device and the manipulator arm can be separated a certain distance from each other, and can communicate through the transmission of electrical signals by communications cable or wireless.
    The relationship between the movements of the user's hand (haptic) and the movements of the laparoscopic tool (manipulator arm) can be established in two ways, at the user's choice. The first is based on defining a translation / orientation of the haptic device as a translation / orientation of the distal end of the laparoscopic tool (for example, clamp), such that a Cartesian displacement of the user's hand corresponds to a Cartesian displacement of the distal end of the laparoscopic tool. The second translates the translation / orientation of the haptic device into an equivalent translation / orientation of the proximal end of the laparoscopic tool, that is, the position / orientation of the end of the laparoscopic tool that is coupled to the manipulator. In turn, the system allows a fully adjustable movement scaling, so that for example a 1 cm offset in the haptic device results in a 1 mm offset in the manipulator device (scale 1:10).
    The pivot movements of the laparoscopic tool are made around the fulcrum, which introduces a ligature (two degrees of Cartesian freedom are lost in the movement) that prevents the free movement of the laparoscopic tool handled by the manipulator. Therefore, the manipulation system has an element that transparently translates geometrically the movements commanded by the user into pivot movements of the laparoscopic tool whose center is in the fulcrum.
    Each manipulator arm of each surgical robot has a force and torque measuring device coupled on its final effector that allows obtaining a measurement of the forces and contact pairs between the laparoscopic tool and the patient, which can originate in two distinct areas : the fulcrum and the distal end. The contact forces on the fulcrum are called reaction forces and appear when the pivot movements of the laparoscopic tool are made around a point that does not coincide with the fulcrum, while the contact forces on the distal end are called the forces of manipulation and appear when an interaction occurs between the laparoscopic tool and the patient's internal tissue. Both components of the contact force can be produced simultaneously but the force and torque measurement device collects the measurement of the total sum of the contact forces, so the system incorporates an algorithm for the modeling of the contact forces capable of separate contributions to the measurement of reaction forces and handling forces. Thus, with a low magnitude in the measurement of contact forces it is considered that the relevant interaction occurs in the fulcrum, in which case no order is transmitted to operate the haptic device and the measurement of contact forces is fully employed in estimate the position of the fulcrum. On the contrary, with a high magnitude in the measurement of contact forces it is interpreted that the relevant interaction is given by the action of the distal end of the laparoscopic tool on the patient. In this case the measurement of contact forces is used to actuate the haptic device to simulate the sensation on the user of the laparoscopic tool pressure, maintaining the fulcrum estimation until the surgical tool stops exerting these high magnitude contact forces .
    The contribution of the reaction forces is used to accurately estimate the location of the fulcrum during the movement of the laparoscopic tool. Since the manipulator is a servo-activated device without mechanisms of passivation of forces and this displacements are made around the fulcrum, an incorrect location of this position can lead to injuries around the incision through which the laparoscopic tool is introduced into the patient. Therefore, the fulcrum is estimated through a balance of forces and reaction pairs. This estimate is processed by a control element that is responsible for correcting the positioning of the laparoscopic tool, so that it is always aligned with the fulcrum so that the force exerted on the patient at that point is minimal.
    During a surgical intervention, the manipulation of the patient's internal tissue by the laparoscopic tool can also be measured through the contribution of forces and manipulation pairs. In order for the user to have pressure sensations similar to those he would have if he directly manipulated the laparoscopic tool (without the mediation of the surgical robot), an algorithm for estimating the stiffness of the patient's internal tissues processes the contribution of the forces of manipulation (without taking into account the contribution of the reaction forces on the fulcrum point) to model a contact force such that it allows the user to perceive through the haptic device different degrees of stiffness of the internal tissue manipulated by the laparoscopic tools. These measurements are used in the actuators of the haptic device in such a way that they move it in the opposite direction to the movement, creating a sensation of pressure on the user's hand.
    Each element that integrates the entire remote teleoperation system of the surgical robots through the console


    Managed by the surgeon, whether physical devices or control algorithms, include an additional layer of operational supervision whose mission is to analyze that all elements work correctly. Errors may occur locally in a control device or algorithm, or they may be the result of a bad interaction between several of the control devices or algorithms. The supervisory layer considers all possible errors that may alter the normal operation of the remote teleoperation system of the surgical robots and assigns them a risk index, so that with a risk index under the supervisor, it will conveniently modify the operation of the / the control devices and / or algorithms involved in the error to be able to continue with the intervention, while with a high risk there will be a system arrest and manual removal of surgical robots by human assistants.
    Other advantages and features of the invention will be apparent in view of the description presented below.
    Brief description of the figures
    To complement the description and in order to help a better understanding of the characteristics of the invention, according to an example of practical implementation thereof, a set of figures in which with character is accompanied as an integral part of the description Illustrative and not limiting, the following has been represented:
    Figure 1 represents a schematic of a robotic surgical system suitable for implementing the method of the invention. A surgical intervention is represented by a teleoperated system in which the surgical robot or slave element performs the surgical maneuvers on the patient, while the surgeon sends the movement commands remotely to the surgical robot through the console or master element.
    Figure 2 represents a flow chart describing the relationships between the different elements of the system that the surgical robot controls from the console.
    Figure 3 schematizes a robotic arm and a laparoscopic surgical tool coupled to its distal end and represents the proposed methodology for spherical navigation of laparoscopic tools according to a possible embodiment of the invention.
    Figure 4 shows the interaction between the laparoscopic tool coupled to the surgical robot and the two main points of contact with the patient: the skin and the internal tissue, according to a possible embodiment of the invention.
    Figure 5 shows a block diagram representing the control algorithm used to estimate the position of the fulcrum, in accordance with a possible embodiment of the invention.
    Figure 6 shows a block diagram representing the control algorithm that is responsible for modeling the force perceived by the surgical robot to reproduce it in the haptic device managed by the surgeon, in accordance with a possible embodiment of the invention.
    Description of an embodiment of the invention
    The following description should not be construed as limiting, but serves the purpose of describing the principles of the invention broadly. The following embodiments are described by way of example, with reference to the aforementioned figures showing representations of algorithms and methods according to the invention and apparatus and systems suitable for implementing said algorithms and methods.
    Figure 1 shows a schematic of a robotic surgical system that implements the method of the invention. Figure 1 represents a minimally invasive surgical intervention. Examples of interventions in which minimally invasive surgery can be used are abdominal (cholecystectomy, nephrectomy, prostatectomy ...), intracranial (tumor resection ...) or traumatology (arthroscopy, orthopedics ...), among others. In figure 1 an abdominal laparoscopic intervention has been represented, in which the surgeon 1 works on a console 4 from which he controls the movements of the surgical robot 8. The surgical robot 8 is the one that operates the patient 2 prostrate on the stretcher of operations 3. The console or interface 4, managed by a human user, acts as a master system. The surgical robot 8 that manipulates the surgical tools 12 13 (in this case, minimally invasive instruments) acts as a slave system. The surgical robot 8 is formed by three robotic units 9. Each of them carries a robotic arm or manipulator arm. The surgical robot 8 can be formed by more or less robotic units 9. Each robotic unit has at least 6 degrees of freedom. The manipulator arm is explained in more detail in relation to Figures 3 and 4. One of the robotic units is configured to carry an endoscope 12 with a laparoscopic camera 11 and the other or other robotic units are configured to carry a minimally invasive instrument ( such as a laparoscopic surgical tool) 13 proper. The term "surgical tool", "laparoscopic tool" or "minimally invasive instrument" is used throughout this text in a general way, so that they refer not


    only to surgical tools themselves, such as scalpels or tweezers, but also to any equipment that supports the operation or diagnosis, such as endoscopes, cameras, etc. Each manipulator arm of each robotic unit has a sensor (force and torque measuring device) 10 coupled on its final effector that allows obtaining a measurement of the forces and contact pairs between the laparoscopic tool and the patient 2. The robotic unit 9 which carries the endoscope 12 (and camera 11) also carries a sensor 10 such as those mentioned, although it is not illustrated in Figure 1. In use of the robotic surgical system, each robotic unit 9 is arranged near the couch 3 and the personnel of surgery guides the distal end of the manipulator arm (of each robotic unit 9) until the surgical tool 12 13 is introduced by a trocar that has been previously inserted through the skin of the patient 2 through an incision. That is, minimally invasive instruments or surgical tools 12 13 are introduced through the incision, through the trocar, into the patient. The manipulator arm is then ready for use in the surgical operation.
    The master system includes, in addition to the control console 4, at least one screen 6 that allows to visualize in real time the surgical field in two or three dimensions thanks to the images taken by the camera 11 of the endoscope 12. The master system also includes an actuator device, not illustrated in Figure 1, by which the operation of the surgical tools 12 can be activated or deactivated. 13. In a possible embodiment, the actuator device is implemented by one or more pedals. The master system also includes two servo-actuated and sensed mechanical devices (haptics) 5, which on the one hand record the movements made by the user's hands to move and orient individual reference points determined by each haptic 5, and on the other hand allow transmitting a force on the hands of the user through the servo actuators in the hands of the user, so that the user can perceive the contact of the laparoscopic tools 13 with the patient 2.
    Each robotic unit 9 of the slave system (surgical robot 8) comprises a robotic arm (that is, a servo-actuated and sensed device) independent (of other robotic arms of other robotic units 9), at whose distal end a surgical tool 12 is coupled. The function of this tool is to reproduce the movements registered by an associated haptic device 5 so that said tool 12 13 moves synchronously with the user's hand. The haptic device 5 and the manipulator arm associated therewith can be separated a certain distance from each other and can communicate through the transmission of electrical signals by communications cable or via wireless. Each manipulator arm of each surgical unit 9 has a device (sensor) 10 for measuring forces and torques coupled on its end effector (distal end of the manipulator arm) that allows obtaining a measurement of the forces and contact pairs between the surgical tool and the patient, as described in detail below.
    That is, the surgeon 1 can see the surgical field through the screen 6, which receives the image of the laparoscopic camera 11. The surgeon can move with his hands the haptic devices 5, a movement that is registered and sent to the robotic units 9. You can also send recorded voice commands through a microphone 7 to move the robotic unit 9 that holds the optic or endoscope 12. The movement of the robotic units 9 that hold the laparoscopic tools 13 and / or the endoscope 12 (tools surgery in general) can produce force reactions in the patient that are measured with the respective force sensors 10. The mode of movement of the robotic units 9 can be selected by the surgeon 1 according to two possible modalities: The mode "A "Relates a displacement of the haptic devices 5 with a displacement of the distal end of the laparoscopic surgical tools 12 13, while f the mode "B" relates a displacement of the haptic devices 5 with a displacement of the proximal end of the laparoscopic tools 12 13.
    Figure 2 shows the flow chart that follows a control algorithm (or set of control algorithms) of the system described in Figure 1 for communications between one of the haptic devices 5 and one of the robotic units 9, which in the Figure 2 is referred to as 23, according to a possible embodiment of the invention. This set of control algorithms is executed in the robotic unit, except for the part related to the haptic device 15 and to the actuator 17, which is executed from the console or control unit 4 illustrated in Figure 1. Specifically, the algorithms are executed in computing or computer means comprising processing means, such as a microprocessor, processing unit, or any conventional alternative processing means, and conventional memory storage means. The surgeon's hand 14 directs the movement of the haptic device 15, which is displaced and oriented 31 around the axis of the laparoscopic tool (minimally invasive instrument) by the surgeon's hand 14. The haptic device 15 transmits 32 to the actuator device 17 position {H} PH and torqueAbsolute H of the haptic device 15, preferably by a signal filtered with a Butterworth low-pass filter order-1. Torsion is one of the three components of the orientation of the haptic device 15. The actuator device 17 is preferably implemented by a pedal or clutch pedal configured to be operated by the surgeon's foot 16. The surgeon's foot 16 presses or releases the clutch pedal 17, sending the signal indicating the presence or absence of drive 33 to the drive device 17.
    If pedal 17 is NOT pressed 34, on the one hand references 18 (and stored in memory) of the
    P
    absolute position {H} PHP of haptic device 15, absolute torsionH of the haptic device 15 (received by signal 32) and the homogeneous matrix {B} T {R} P of the final effector 55 (illustrated in Figures 3 and 4) of the manipulator arm of the robotic unit to make the difference 38 between position {H} PH and torqueAbsolute H 32 and reference {H} PHP,HP 35 of the relative displacement of the haptic device 15 is 0, and on the other a non-pressed pedal signal is sent to the robotic unit 23 so that the free / manual movement mode is established, so that an assistant can manipulate it with the hands . Note that the homogeneous matrix is a mathematical term that describes a position and orientation of a Euclidean reference system referred to another system of


    base reference in a 4x4 dimension matrix, so that the upper left submatrix of 3x3 dimension describes the orientation with respect to the base system, each column vector being one of the axes of the system, while the 3x1 vector on the right of the matrix corresponds with the Cartesian position with respect to the base system.
    If the pedal YES is pressed 36 then the differences are applied
    HH between absolute position and torsion {H} PH,
    H 32 of the haptic device 15 and the position and reference torque {H} PHP,HP stored in memory 18 to obtain relative displacement 38 of haptic device 15. UnlikePH is applied on the one hand some factors of scaling of position KP and torsion K
    established by the surgeon to increase the precision of the movement, and on the other hand a reduction factor Ks whose expression is a sigmoid function that depends on the feedback force FH 50 obtained from a stiffness estimator 30 detailed below. These factors of position and torsion scaling and reduction can be applied both in a navigation model 19 and in the previous stage, in which the differences between the absolute position and torsion of the haptic device 15 and the position and torsion of reference stored in memory to obtain the relative displacement 38 of the haptic device 15. This feedback force FH 50 is parameterized by a value
    which indicates the minimum value of Ks, a value
    which indicates for which force feedback FH 50 the maximum value of Ks is produced and a value c that indicates how steep the slope of rise / fall of the Ks is, whose mission is to decrease the speed in the movement of the surgical tool when This comes into contact with the patient's internal tissue to improve the stability of the feedback control algorithm of contact forces with the patient's tissue to the surgeon:
    H sP HH
    Ks c (F
    )
    H
    1 e
    KP
    [one]
    H HH
    {H} {H} P KK PP
    Figure 2 also includes a navigation model 19 comprising a planning algorithm of the next spherical position of the distal end of the surgical tool. For the planning of the spherical position, the navigation model 19 receives the relative displacement 38 of the haptic device 15, already scaled, the homogeneous matrix {B} T {R} P 37 of the final effector 55 of the robotic arm with the position and orientation (torsion) Cartesian reference at the time of pressing pedal 17, the homogeneous matrix with the modeled Cartesian position and orientation 45 of the robot (robot model 25) to calculate the next position of the distal end of the laparoscopic tool or minimally invasive instrument , and the estimation of the fulcrum position 48 provided by a fulcrum estimator 29 to obtain the next planned position 39 of the final effector 55 of the robotic arm. Throughout the description in Figure 2, when the “robot model 25” is mentioned to be precise, we refer to the “robotic unit model 25”, but sometimes, for simplicity, the term “robot "
    To explain in more detail the navigation model 19, Figure 3 represents the robotic arm or manipulator arm 52 of a robotic unit 9 (23 in Figure 2). In Figure 3, the manipulator arm 52 is making spherical movements around the fulcrum point 57 located on the skin of the patient 53. The fulcrum point 57 is the insertion point in the patient of the surgical tool. The fulcrum point is located in the incision made in the patient's skin. Figure 3 illustrates the problem of spherical navigation solved by the navigation model 19. A coordinate system {I} is defined on the fulcrum point 57. The axes of the coordinate system {I} remain parallel to those of a system reference {B} associated with the base 54 of the robotic unit 9. A reference system {R} associated with the end effector 55 of the manipulator arm 52 and a reference system {T} associated with the distal end of the tool is also defined laparoscopic 56, both with their main steering axes parallel to each other. The location of the final effector 55 of the manipulator arm 52 with respect to the fulcrum point 57 is established through the spherical coordinates defined as the orientation angle
    58, altitude angle
    59, torsion orientation
    60 around its own axis and outer distance
    61 or distance along the instruments covering from the center of rotation of the final effector 55 to the fulcrum point 57. Note that the angles
    Y
    they can be obtained with the direct reading of the internal sensors of the robot, which does not happen with the external distance. Note that the internal sensors of the robot are not the sensors 10 located in the end effector of the manipulator arm (see Figure 1), but that they are sensors assembled internally in the actuators of the motor of each robotic unit, to make measurements on their position , speed, etc. These internal sensors are outside the scope of the present invention.
    The spherical navigation is established by the vector of spherical components (,,,), which can be obtained from the relationship between the homogeneous matrix {I} T {R} expressed in Cartesian and spherical coordinates, which defines the position and Cartesian orientation of the final effector 55 of the manipulator arm 52 with respect to the point of fulcrum 57. This homogeneous matrix {I} T {R} can be calculated from its relationship with the homogeneous matrix {B} T {R} of the final effector 55 of the manipulator arm 52 with respect to the base 54 and with the homogeneous matrix { B} T {I} of the fulcrum point 57 with respect to the base 54. The homogeneous matrix {B} T {R} of the final effector 55 of the manipulator arm 52 with respect to the base 54 is obtained 45 by the direct kinematics algorithm 26 (explained below, see Figure 2); the homogeneous matrix {B} T {I} of the fulcrum point 57 with respect to the base 54 is obtained 48 by the fulcrum estimator algorithm 29 (see Figure 2):


    {I} {B} {B}
    TYOU}1T {R} {R}
    cos cos
    without
    cos without
    cos without
    cos
    without 0 without
    cos cos sin sin sinwithout without
    cos
    0
    {I}
    [2]
    T
    {R}
    without 0 cos cos
    0 01 000 1
    0 00
    With this principle, the homogeneous matrix of the following position {B} P'R and orientation {B} z '{R} of the axis of the laparoscopic tool 39 can be calculated from the position {B} PRP and orientation {B} zRP of the reference axis 37 of the final effector 55 of the robotic arm, of the length of the laparoscopic tool L and of the increase in displacement of the haptic device
    H 38 according to the movement mode set for the laparoscopic tool. Thus, in mode A, in which the displacements of the haptic device 15 correspond to displacements of the distal end of the laparoscopic tool, the geometric relationships are of the Cartesian type, while in mode B, in which the displacements of the device Haptic 15 correspond to spherical displacements () of the proximal end of the laparoscopic tool with respect to the spherical reference positions (P), the geometric relationships are spherical:
    {B} PT
    {B} P
    {B} P
    L z
    PR
    {R}H
    {B}
    A z mode
    {R}
    {B} PIPT
    {B}
    {B}
    {B}
    P
    L z
    PR
    T {R}
    [3]
    B mode
    That is, in mode B, the spherical coordinate vector of the next planned position and orientation 40 is calculated (see "kinematic supervisor 20" of Figure 2).
    In Figure 2, the kinematic supervisor 20 represents an algorithm that verifies, from the current position and orientation 45 of the final effector of the robot model 25, the planned position and orientation 39 by the navigation model 19 and the position and orientation 41 of other robotic units 22, if any, that the planned position and orientation 39 for the final effector 55 of the robotic unit meet certain safety criteria, keeping the laparoscopic tool within a valid working area. Some possible safety criteria are that the distal end of the surgical tool remains within the visible surgical field, or that the proximal end of the surgical tool (final effector 55 of the robotic unit 23) remains at a minimum distance from other robotic units , or that the surgical tool can perform spherical navigation within a subspace such that physical limits have to be met such as not introducing the final effector 55 of the robotic unit 23 beyond the fulcrum point 48 estimated by the estimator of fulcrum 29 so that the outer distance is zero, or that the spherical angle of altitude does not exceed 90 ° since the distal end of the surgical tool would attempt to leave the patient's skin. In the case of not fulfilling any of these kinematic criteria, the kinematic supervisor 20 limits the planned position and orientation 39 of the final effector 55 of the robotic unit 23 (planned by the navigation model 19) so that they do not advance outside the work area .
    In Figure 2, the inverse kinematics 21 represents an algorithm that receives the current position and orientation 45 of the final effector of the robot model (obtained by the direct kinematics algorithm 26, explained below) and the spherical coordinate vector of the next planned position and orientation 40 and restricted by the kinematic supervisor 20 of the final effector of the robotic unit 23, information that is converted into the articular positions and speeds 42 necessary for each degree of freedom of the robotic unit 23 moved by an actuator locate the next planned position and orientation 40 of the final effector of the robotic unit 23.
    The actuators of the robotic unit 23 receive the articular positions and speeds 42 from the inverse kinematics algorithm 21. The articular positions and speeds 42 are processed by a gain-based position and speed control to ensure that trajectory planning is followed Cartesian calculated by the navigation model 19. Cartesian trajectory planning will reproduce the interaction between laparoscopic tools and patient 24 (interaction desired by the surgeon). As the output of the robotic unit 23, the positioning and speed sensors of the robotic unit itself measure 43 the joint position and speed parameters.
    The model of the robot 25 represents an algorithm that calculates the dynamics of the actuators of the robotic unit 23 by means of a model of the real behavior of the actuators, so that before the same setpoint and velocity setpoints 42 desired for each actuator, obtained from reverse kinematics 21, the


    positions and articular speeds 43 of the robotic unit 23 evolve in a similar way to the positions and articular speeds 44 in the robot model 25. The function of the robot model 25 is to reduce instabilities caused by differences between the sampling frequency at that the status signals of the joint position and speed 43 of the robotic unit 23 in the slave system are updated and the sampling frequency at which both the status signal of the position of the haptic device 15 and the status update are updated 50 of the actuators of the haptic device 15, provided by the stiffness estimator
    30. To minimize the error between the actual joint positions and speeds 43 and the modeled joint positions and speeds 44, the robot model 25 receives the joint position and speed 43 of the robotic unit 23 to update its internal state variables at each time. sampling set by the signals sent by the robotic unit 23.
    Direct kinematics 26 represents an algorithm that transforms the articular position 44 of the robot model 25 into Cartesian coordinates 45, which are used by the navigation model 19 to know the Cartesian reference position of the robotic unit 23 from which calculates the planned position and orientation 39 (for example the spherical navigation path).
    The force sensor 27 moves in solidarity with the final effector of the robotic unit 23, whereby its position and orientation are determined by the articular state 43 thereof. The force sensor 27 includes algorithms to compensate both the gravitational pairs and the inertia exerted by the actuators and sensors integrated in the coupling device of the laparoscopic tool and the laparoscopic tool itself. The measurement of the compensated forces and torques in the force sensor 27 is converted into an electric and filtered signal, preferably by a low-pass Butterworth filter order 1 (obtaining a filtered signal {R} F) so that 46 can be sent to console 4 through the communication channel between robotic unit 23 and console 4.
    The interaction model 28 represents an algorithm that determines in what percentage of contribution the measurement of the compensated forces {R} F 46 is due to the interaction with the fulcrum {R} FI 47 or with the patient's internal tissue {R} FT 49 using the contribution parameters
    IT respectively. This differentiation is made based on the magnitude of the compensated force measurement 46 with a parameterized sigmoid function for each contribution following the following qualitative criteria:
    If the measurement of the compensated forces {R} F 46 is low, then almost all the force is due to the interaction
    If the measurement of the compensated forces {R} F 46 is high, then almost all the force is due to the interaction
    In a preferred embodiment, the contribution parameters are calculated from the following expression: {R} FI
    {R}
    c F 1
    F
    1 e
    [4] 1 {R} FT
    {R}
    F
    c 1 F
    1 e
    The parameter
    I subtracts fromT to cancel the effect of the compensated force measurement {R} F 46 on the interaction force with the patient's internal tissue 49 when the compensated force measurement {R} F 27 reports low values. The parameter
    I adopts almost null values when the compensated force measurement {R} F 46 is high. The parameter
    indicates where the sigmoid maximum occurs, while c serves to increase or decrease the slope of the sigmoid rise / fall.
    The fulcrum estimator 29 represents an algorithm that is responsible, on the one hand, for estimating the external distance
    along the axis of the laparoscopic tool at which the fulcrum point of the Cartesian position 45 (modeled by direct kinematics 26) of the final effector of the robotic unit 23 is located. This outer distance is calculated by applying the Equations of balance of forces and pairs of the signal with the measurement of the forces and compensated pairs due to the interaction with the fulcrum 47. To this estimation of the outer distance is added a Cartesian displacement of the fulcrum in the direction perpendicular to the axis of the laparoscopic tool obtained from an impedance-based force control algorithm which uses as compensation reference the measurement of the compensated forces and torques due to the interaction with the fulcrum 47, obtaining as a result the estimated Cartesian position of the fulcrum 48. Figure 5 details the control algorithm used to estimate the position of the fulcrum 48.
    The proposed method for obtaining the fulcrum point estimate 48 depends on the type of orientation mechanism of the laparoscopic tool installed in the final effector of the robotic unit. In a preferred embodiment, this orientation mechanism of the laparoscopic tool (or minimally invasive instrument) is performed by direct actuation, and is discussed in more detail following the illustration in Figure 4. If the actual location of the fulcrum point {R} PI 57 (see Figures 3 and 4) is different from the estimated one, the error in positioning {R}of the fulcrum generates an unwanted abdominal force {R} FI 63 on the abdominal wall 53. The abdominal force {R} FI 63 can be measured with the force sensor attached to the final effector 55 of the robot. If the scalar magnitude of the force FI and torque MI of interaction with the fulcrum 63 is practically zero then the fulcrum


    estimate coincides with the real one and the fulcrum point estimate 57 must not be updated. Otherwise, the outer distance
    It can be calculated using the following expression obtained from the equilibrium of pairs:
    ME
    FI [5]
    On the other hand, for the interaction between the laparoscopic tool 56 and the abdominal wall 53, a linear elastic behavior is assumed by means of the gain KI, which relates the force vector {R} FI of interaction with the fulcrum 63 with the elongation {R }produced on this surface: {R} FI
    KI {R}
    [6]
    The KI gain is generally obtained from experimental tests in which the interaction force with the fulcrum FI 63 for displacements is measured.
    known. A CI <1 gain is applied to this result, the value of which is chosen to meet the rapid response criteria for a feedback loop and ensure the stability of the control algorithm. Thus, the estimation of the position of the fulcrum point {R} PI 57 is given by the sum of the elongation of the abdominal wall recorded by the measurement of the interaction force with the fulcrum 63 and the estimation of the outer distance to the fulcrum obtained by equilibrium of pairs and which is in the direction of the {R} z axis of the final effector 55 of the manipulator arm 52: {R} PICI {R}
    {R}
    FI
    z
    [7]
    Ki
    Figure 5 shows the control algorithm used to estimate the position of fulcrum 48 according to the procedure set forth above. Outer distance
    67 is calculated from the expression [5]. That is, the outer distance
    67 is calculated from the current Cartesian orientation {R} z 45 from direct kinematics 26 and from the contribution of forces {R} FI and pairs {R} MI of interaction with the abdominal wall 47 from the interaction model 28. This contribution of forces {R} FI and pairs {R} MI of interaction with the abdominal wall 47 is fed back by subtracting a desired reference force {R} F0 68 for interaction with the abdominal wall. The result 69 of this subtraction is weighted with the control gain CI 65, and the result of this weighting 70 is converted from a magnitude in forces to a magnitude in distances with the conversion factor KI 66. The result of that conversion 71 is sum with the exterior distance estimation vector{R} z 72 to finally obtain the Cartesian position {R} PI of fulcrum point 48 and send it to navigation model 19 to plan spherical navigation.
    In Figure 2, the stiffness estimator 30 represents an algorithm that is responsible for dynamically estimating the stiffness of the tissue in contact with the distal end of the tool by measuring compensated forces and pairs due to the interaction with the internal tissue of the patient 49 (obtained by the interaction model 28), so that the relationship between the force and the displacement of interaction with the patient's internal tissue can be modeled with a linear system. This estimation of the stiffness of the internal tissue of the patient is part of an algorithm of estimation by least squares, whose mission is to stabilize the value of the stiffness of the internal tissue with a delay as small as possible, with which the perception of contact of the surgeon's hands 14 through the haptic devices 15, between solid and soft objects. With this estimate of stiffness a simulated reaction force 50 is calculated, proportional to the displacement 51 of the haptic device 15 performed by the hand of the surgeon 14 taking as reference the position of the haptic device 15 in which a measurement of the first time was detected. forces and pairs 49 due to interaction with the patient's internal tissue
    49. That simulated reaction force 50 is scaled to perceive contact in the surgeon's hands as a natural reaction, and subsequently sent to the actuators of the haptic device 15.
    The control algorithm of the stiffness estimator 30 of Figure 2 is detailed in Figure 6 and is responsible for modeling the force perceived by the robotic unit as a simulated force {H} FH 50 that acts in the opposite direction to the movement of the haptic device 15. This force is simulated by a model of the reaction of elastic-linear forces 73 with dynamic stiffness KT, whose equilibrium point starts from the last haptic position {H} PH0 and whose current haptic position is {H} PH 32. A Once the force 75 is modeled by the force reaction model 73, a scaling factor KF <1 74 is applied to improve the stability of the system. The following expression represents the simulated force obtained 50:
    {H} FH
    {H} PH
    {H} 0
    [8]
    KFKT
    PH
    The dynamic stiffness KT is a variable parameter that allows to perceive different resistance in the haptic 15 as a function


    of the material in contact with the laparoscopic tool. For this reason it is necessary to determine this magnitude based on measurements of forces {R} FT of interaction with the internal tissue 49 obtained from the real environment of the robotic unit 23 through the interaction model 28. And also for that reason it is necessary to determine the dynamic stiffness KT as a function of the current position of the distal end of the tool {R} PT 45 (note that from the homogeneous matrix that describes the position and orientation of the robot, both the vector of the current Cartesian orientation can be extracted {R } z as the current position of the distal end of the tool {R} PT) obtained from the direct kinematics 26 of the surgical robot and the distal position of the end of the tool at the time of
    contact {R} PT0:
    Tk TF 0 T {R} T {R} PPT T P F[9]
    Since this result is instantaneous and highly variable, especially in the immediate vicinity of the contact point due to the amplification of the noise of the signal that registers the small deformations T, a recurring least squares estimation algorithm is applied. With this method, a stable KT value can be obtained after a few sampling cycles. The recurring least squares algorithm consists of the following steps:
    Start of method (iteration N = 0):
    Ke (0) 0 [10]
    C (0) [11]
    Where a sufficiently large number must be (the higher the KT varies with respect to each iteration), and C is a parameter of the algorithm that evolves with the iterations.
    In the Nth iteration, calculate the new estimate of KT according to:
    PT (N) · C (N) KT (N 1) KT (N) (FT PT (N) · KT (N))
    2 [12]
    1 PT (N) · C (N)
    Update C:
    C (N)
    C (N 1) 21 PT (N) · C (N) [13]
    Return to step 2.
    In sum, the method of the invention overcomes the main limitations detected in the state of the art as explained:
    With respect to conventional control methods, which allow the surgeon to perceive the interaction of forces between the surgical tools and the patient, but they do not take into account the superposition of the forces exerted by the laparoscopic tool on the insertion point and the of manipulation of the patient's internal tissue: The described method takes into account, in that measurement of forces and torques between the surgical tools and the patient, what percentage of the measurement is due to the interaction with the fulcrum point and what percentage of the Measurement is due to the interaction with the patient's internal tissue. The contact forces on the fulcrum (reaction forces) appear when the pivot movements of the laparoscopic tool are made around a point that does not coincide with the fulcrum, that is, when an incorrect estimate of the insertion point occurs. Contact forces on the distal end (manipulation forces) appear when an interaction occurs between the laparoscopic tool and the patient's internal tissue. Both components of the contact force can be produced simultaneously but the force and torque measuring device collects the measurement of the total sum of the contact forces. The method models the contact forces and is able to separate the contributions to the measurement of the reaction forces and the handling forces. Each manipulator arm has a force control system that uses, on the one hand, the manipulation force to obtain an estimate of the stiffness of the patient's internal tissue with which to model a contact force with a hard tissue
    or soft that subsequently is fed back to the haptic interface, and on the other hand, the reaction force to obtain a better estimate of the position of the insertion point with which to minimize the magnitude of said force by planning trajectories of the laparoscopic tool around the actual insertion point.
    Regarding the proposals for the control of movements of the laparoscopic tools operated by a surgical robot that depend on mechanisms that either produce a certain strike / inaccuracy in the positioning of the surgical tools, or require off-line recalibration, both when start of the intervention


    as before the displacement of the fulcrum point due to factors such as a possible displacement of the patient on the stretcher: The described method estimates the position of the fulcrum point with the equation [7]. With this fulcrum estimation, a control algorithm is applied (Figure 5) that moves the robot's laparoscopic tool so that it is aligned along the fulcrum, so that it minimizes the force exerted on the abdominal wall of the
    5 patient In addition, this estimation of the fulcrum position is used to perform spherical navigation and that new movements of the laparoscopic tool are made around this point.
    Finally, with respect to conventional surgical robots that only allow one type of correspondence between the movement of haptic devices and laparoscopic tools, so that the position of the final effector of the haptic device can only correspond to the position of the end distal of the laparoscopic tool operated by the surgical robot: The described method allows to select, through an interface of the control console (for example through a touch screen, a minimally invasive instrument movement mode: a first modality in which relates the displacement of the haptic device with the displacement of the distal end of the minimally invasive instrument; or a second modality
    15 in which the displacement of the haptic device is related to the displacement of the effector of the manipulator arm (i.e. with the proximal end of the minimally invasive instrument), so that the pivot movements of a minimally invasive manual instrument are simulated through the haptic device
    In this text, the word “understand” and its variants (such as “understanding”, etc.) should not be interpreted in an exclusive way, that is, they do not exclude the possibility that what is described includes other elements, steps etc. In the context 20 of the present invention, the term "approximately" and the terms of its family (such as "approximate", etc.) should be understood as indicative values very close to those accompanying the aforementioned term. That is to say, a deviation should be accepted within the acceptable limits from an exact value, since the person skilled in the art will understand that said deviation from the indicated values is inevitable due to inaccuracies in the measurement, etc. the same applies to the terms "around" and
    25 "substantially."
    On the other hand, the invention is not limited to the specific embodiments that have been described but also covers, for example, the variants that can be made by the average person skilled in the art (for example, in terms of the choice of materials, dimensions , components, configuration, etc.), within what follows from the
    30 claims

    权利要求:
    Claims (10)
    [1]
    1. A method of handling a robotic system for minimally invasive surgery, where the robotic system comprises:
    a control console (4) comprising at least one actuator device (17) and a haptic device (5, 15) which in turn comprises one or more positioning sensors and servo actuators,
    and at least one robotic unit (9, 23) comprising:
    a manipulator arm (52),
    an effector (55) disposed at the distal end of said manipulator arm (52), said effector being
    (55) equipped with at least one force and torque sensor (10, 27),
    at least one actuator,
    and a minimally invasive instrument (12, 13, 56) coupled to said effector (55), where the distal end of said minimally invasive instrument (12, 13, 56) is configured to enter a cavity of a patient's body through of a fulcrum point (57),
    said method being characterized by:
    plan a position and orientation (39) of said effector (55) from a relative displacement (38) of said haptic device (15), of reference coordinates (37) of said effector (55), of coordinates ( 45) of the effector (55) according to a model (25) of the robotic unit (23) and an estimate (48) of the fulcrum position;
    from said coordinates (45) of the effector (55) according to said model (25) of the robotic unit (23) and of the planned position and orientation (39) of the effector (55), obtain joint positions and speeds (42 ) necessary so that each degree of freedom of the robotic unit (23) moved by said actuator causes, as a whole, the following planned position and orientation (39) of the effector (55) to be achieved;
    moving the effector (55) by means of said at least one actuator according to said articular positions and speeds (42);
    measuring (46) by said at least one force and torque sensor (10, 27) coupled to said effector (55) forces and torques exerted by said effector (55) and by said minimally invasive instrument (13, 56) coupled to the same, when making said movement;
    determining (28) in what percentage of contribution said measurement (46) of forces and pairs is due to the interaction with the fulcrum point (47) or to the interaction with the patient's internal tissue (49);
    re-estimate (48) the position of the fulcrum, where said estimate (48) is made from the contribution due to said interaction with the fulcrum point (47) and said coordinates (45) of the effector (55) according to said model (25) of the robotic unit (23);
    estimate (50) the stiffness of the tissue in contact with the distal end of the minimally invasive instrument (13, 56) and calculate a simulated reaction force (50);
    Send this simulated reaction force (50) to at least one servo actuator of the haptic device (15) to be provided to the surgeon's hand (14).
    [2]
    2.  The method of claim 1, wherein said coordinates (45) of the effector (55) according to said model (25) of the robotic unit (23) are obtained from an articular position (44) of said model (25) .
    [3]
    3.  The method of any of the preceding claims, wherein said relative displacement (38) of said haptic device (15) is obtained from the difference between an absolute position and torsion (32) of the haptic device (15) and a position and reference torque (18).
    [4]
    Four. The method of claim 3, wherein said difference between an absolute position and torsion (32) of the haptic device (15) and a reference position and torsion (18) is applied with scaling factors of position KP and torsion K
    established by the surgeon to increase the precision of the movement, and a reduction factor Ks related to said simulated reaction force (50).
    [5]
    5. The method of any of the preceding claims, wherein to perform said fulcrum estimation (48), the outer distance is estimated
    along the axis of said minimally invasive instrument (13, 56) to which the fulcrum point is located with respect to the position (45) of the effector (55) according to said model (25) of the robotic unit (23) .
    [6]
    6. The method of any of the preceding claims, wherein said estimate (50) of the stiffness of the tissue in contact with the distal end of the minimally invasive instrument (13, 56) and calculation of a simulated reaction force (50) it is made from the contribution due to the interaction with the patient's internal tissue (49), of said coordinates (45) of the effector (55) according to said model (25) of the robotic unit (23) and of the displacement
    (51) of the haptic device (15) performed by the surgeon's hand (14).
    [7]
    7. The method of any of the preceding claims, wherein said calculation of a reaction force

    Simulated (50) is made from the following expression:
    {H} FH
    {H} 0
    KFKT
    {H} PH PH
    where {H} FH represents the simulated force (50), KF is a scaling factor, with KF <1, KT is the dynamic stiffness, {H} PH is the current haptic position (32) and {H} PH0 is the Last haptic position.
    The method of any of the preceding claims, further comprising: from the position andorientation (45) of the effector (55) according to said model (25) of the robotic unit (25), of the position and orientationplanned (39) and the position and orientation (41) of other robotic units (22), if any, verify that theplanned position and orientation for the final effector (55) of the robotic unit (9, 23) meet criteria ofsecurity, and restrict (40) said position and orientation in case these criteria are not met.
    The method of any of the preceding claims, further comprising:
    through an interface of the control console (4), select a minimally invasive instrument movement mode (13, 56): a first modality in which the displacement of the haptic device (15) is related to the displacement of the end minimally invasive instrument distal (13, 56); or a second modality in which the displacement of the haptic device (15) is related to the displacement of the effector
    15 (55) of the manipulator arm, so that pivot movements of a minimally invasive instrument (13, 56) are simulated through the haptic device (15).
    [10]
    10.  The method of any of the preceding claims, in any of the preceding steps is carried out if said actuator device (16) is pressed or operated.
    [11]
    eleven.  The method of any of the preceding claims, wherein the actuator device (16) is a pedal.
    A computer program product comprising instructions / computer program code for performing the method of any of the preceding claims.
    [13]
    13. A computer-readable media / storage medium that stores program code / instructions
    to perform the method according to any one of claims 1 to 11. 25




    类似技术:
    公开号 | 公开日 | 专利标题
    JP2018110873A|2018-07-19|Collision avoidance during controlled movement of image capturing device and manipulatable device movable arms
    Burgner et al.2013|A telerobotic system for transnasal surgery
    JP2019524284A|2019-09-05|Perform robot system movements
    US9283049B2|2016-03-15|Control system configured to compensate for non-ideal actuator-to-joint linkage characteristics in a medical robotic system
    KR102189666B1|2020-12-11|Phantom degrees of freedom for manipulating the movement of mechanical bodies
    Zemiti et al.2007|Mechatronic design of a new robot for force control in minimally invasive surgery
    KR102206198B1|2021-01-22|Surgical robot system and method of controlling the same
    Haidegger et al.2009|Force sensing and force control for surgical robots
    KR20150043441A|2015-04-22|Phantom degrees of freedom in joint estimation and control
    KR20150043429A|2015-04-22|Phantom degrees of freedom for manipulating the movement of surgical systems
    EP2047805A1|2009-04-15|Robotic system for assisting in minimally-invasive surgery, which can position a surgical instrument in response to orders from a surgeon, is not attached to the operating table and does not require pre-calibration of the insertion point
    KR20190007505A|2019-01-22|Computer Assisted Remote Operation Surgical System and Method
    Gibo et al.2009|Design considerations and human-machine performance of moving virtual fixtures
    Beasley et al.2009|Increasing accuracy in image-guided robotic surgery through tip tracking and model-based flexion correction
    Vandini et al.2014|Vision-based motion control of a flexible robot for surgical applications
    ES2877800T3|2021-11-17|Robotic system for minimally invasive surgery
    Bihlmaier2016|Endoscope robots and automated camera guidance
    Bauzano et al.2013|A minimally invasive surgery robotic assistant for HALS–SILS techniques
    US20210338354A1|2021-11-04|Systems and methods for controlling a robotic manipulator or associated tool
    ES2203318B1|2005-03-01|TELEOPERATION SYSTEM OF ROBOTS FOR LAPAROSCOPIC SURGERY.
    ES2181526B1|2004-04-01|ROBOTIC ASSISTANT SYSTEM FOR LAPAROSCOPIC SURGERY.
    Bauzano Nuñez et al.2015|Planning Automatic Surgical Tasks for a Robot Assistant
    Maaroof2020|Design of a robot assisted minimally invasive surgical system for pituitary tumor surgery based on safety features
    CN113613538A|2021-11-05|System and method for view restoration
    WO2021188146A1|2021-09-23|Trocar pose estimation using machine learning for docking surgical robotic arm to trocar
    同族专利:
    公开号 | 公开日
    WO2017220844A1|2017-12-28|
    EP3473202B1|2021-03-03|
    ES2607227B2|2017-11-23|
    EP3473202A1|2019-04-24|
    ES2877800T3|2021-11-17|
    EP3473202A4|2020-02-19|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    WO2005039835A1|2003-10-24|2005-05-06|The University Of Western Ontario|Force reflective robotic control system and minimally invasive surgical device|
    WO2007136768A2|2006-05-19|2007-11-29|Mako Surgical Corp.|Method and apparatus for controlling a haptic device|
    EP1915963A1|2006-10-25|2008-04-30|The European Atomic Energy Community , represented by the European Commission|Force estimation for a minimally invasive robotic surgery system|
    GB201406821D0|2014-04-16|2014-05-28|Univ Leuven Kath|Method and device for estimating an optimal pivot point|
    EP3209237A4|2014-10-24|2018-06-06|Covidien LP|Sensorizing robotic surgical system access ports|RU2736162C2|2019-04-29|2020-11-12|федеральное государственное бюджетное образовательное учреждение высшего образования "Московский государственный медико-стоматологический университет имени А.И. Евдокимова" Министерства здравоохранения Российской Федерации |Multifunctional device with replaceable surgical instruments for measuring forces and moments acting on them during neurosurgical operations|
    法律状态:
    2017-11-23| FG2A| Definitive protection|Ref document number: 2607227 Country of ref document: ES Kind code of ref document: B2 Effective date: 20171123 |
    优先权:
    申请号 | 申请日 | 专利标题
    ES201630855A|ES2607227B2|2016-06-23|2016-06-23|HANDLING METHOD OF A ROBOTIC SYSTEM FOR MINIMALLY INVASIVE SURGERY|ES201630855A| ES2607227B2|2016-06-23|2016-06-23|HANDLING METHOD OF A ROBOTIC SYSTEM FOR MINIMALLY INVASIVE SURGERY|
    PCT/ES2017/070456| WO2017220844A1|2016-06-23|2017-06-22|Method for handling a robotic system for minimally invasive surgery|
    EP17814810.2A| EP3473202B1|2016-06-23|2017-06-22|Robotic system for minimally invasive surgery|
    ES17814810T| ES2877800T3|2016-06-23|2017-06-22|Robotic system for minimally invasive surgery|
    [返回顶部]